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ABSTRACT  ' 

The  Morf-Kallath  discrete  square-root  flltet- 
ing  algorithms  are  extended  to  Incorporate 
sensitivity  Infonaatlon  with  respect  to  the 
assumed  model  and  statistics.  If  the  model  and 
statistics  are  incorrect,  we  presume  that  an- 
other set  of  model  parameters  and  statistics  la 
available,  considered  to  be  the  "actual"  model. 
The  sensitivity  analysis  is  carried  out  by  com- 
puting the  so-called  "variance  ratios"  that  can 
be  obtained  by  a second  set  of  orthogonal  trans- 
forms. These  operations  can  be  performed  either 
in  covariance  or  information  filter  form,  as  the 
actual  filters.  This  leads  to  four  basic  vari- 
ants for  the  propagation  of  the  variance  ratios, 
one  of  them  has  been  obtained  by  Bieman. 

These  ideas  can  also  be  applied  to  other 
related  areas  such  as  smoothing  and  the  dual 
control  problems,  where  it  is  of  interest  to 
study  the  sensitivity  of  the  total  cost  with 
respect  to  different  models  and  weights  of  the 
cost. 

1.  Square-Root  Filters  Applied  to  Sensitivity 

Analysis 

In  this  paper  we  consider  the  linear  discrete- 
tine  dynamic  model,  where  the  superscript  "a" 
denotes  "actual"  model  parameters 


’'i+l"^^i■"^^l 

y^-H*x^  + Vi 


A® 

V ;n  X n 


H^:m  X n 


1 ;n  X p 


for  simplicity,  all  random  variables  have  zero 
mean  and  covariances 


[::115 1 


The  propagation  of  the  square  root  array  is 
based  on  the  identity  in  (1] 
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The  following  factorizations  into  triangular 
components  are  made: 

«3x3  - Vi  - Vi  <®> 

where  is  an  upper  triangular  square-root  of 
the  LHS  of  (5)  and  C2  a lower  triangular  square- 
root  of  the  RHS  matrix. 

A geometrical  interpretation  accompanies  this 
representation  (cf.  [1]).  Indeed,  letting 

-i  “ ^^’l|l-l’*i+lll-l***i|i-l^ 


Cj^^x  and 

are  two  orthonormal  sets  and  £2  respectively) 
for  the  (m  n + p) -dimensional  space  spanned  by 
In  other  words,  geometrically  an  ortho- 
normalization  process  (Gram-Schmidt)  Is  going  on, 
on  X.  is  obtained  by  orthonomalizatlon  of 
the  set  {y^,Xj^j^,u|},  conditioned  on  the  data 
y(0,l-l),  sequentially  from  right  to  left. 

^^i’’'i+i***i^  “ Vi'*’  1-1 ’*1+11  i-i’'*i|  1-1^  (7) 

similarly 

i"  V2 

Is  obtained  by  orthonormallzing  from  left  to 
right 

[yj.x’^l.u’l  ^y'lll-l’*l+l|l-l’®i|l-l^ 

and  the  ^ variables  are  (see  [Ij  for  store 
details) 


In  essence  Is  the  covariance  of  the  random 

variables  x(k  - 1,2).  Now  we  could  also  work 
with  the  inverse  relations: 


- 1.2) 

leading  to  the  so-callcd  Information  filter. 
These  two  representations  are  dual;  we  can  dis- 
tinguish two  types:  Inversion  duality  versus 
the  standard  duality  [1].  Note  that  this  ap- 
proach leads  to  onc-step  predicted  estimates 
*l+lll  errors  (thus  Innovations),  Alter- 
natively we  could  work  with  filtered  estimates 
[1]:  Xin.  or  with  X step  predicted /smoothed 
estimate  [4] . 

Suppose  now  that  we  do  not  know  the  actual 
covariances  as  given  In  (3)  and  (4);  we  use  a 
sK>del  containing  the  estimated  covariances: 


Pq  and 


Qi  c; 


(9) 


Similarly,  the  system  parameters  may  be  incor- 
rectly known,  so  that  we  propagate  the  Kalman 
filter  (and  thus  the  array's  and  C2)  as  if 
the  system  model  were: 

+ r ♦j^:n  X n rj:n  x p (10) 


y •=  H^Xj^  + Vj^  Hj^:m  x n 


(11) 


Therefore,  x as  computed  by  the  filter  is  not 
the  minimum  variance  estimate,  and  there  will 
be  a discrepancy  between  the  computed  and  the 
actual  error  covariances.  This  deterioration 
of  filter  accuracy  can  ultimately  lead  to  filter 
divergence.  As  a measure  for  this  discrepancy 
we  define  the  variance-ratios  £p 

E_  “ (P®)  2/2pl/2  ^pS  _ error  covariance.) 

^ (12) 

In  our  geometric  picture,  the  variables 

for  k “ 1,2,  (we  reserve  ^ for  truly 

orthonormal  variables  in  this  paper)  will  no 
longer  be  orthonormal.  ... 

x^  = XjL  - still  equal  pj'  Xj, 

where  pj^^  la  the  square  root  of  the  error  co- 
variance  as  calculated  by  the  filter,  but 
will  not  have  unit  covariance.  The  square  root 
of  cov  X will  be  the  variance  ratio 


We  present  algorithms  in  which  is  propagated 
as  an  entry  in  arrays  which  express  the 
Tj-random  variables  in  terms  of  truly  orthonormal 
sets. 


k - 1,2  (13) 

Obviously,  just  as  with  the  filter  Itself,  we 
can  implement  this  propagation  In  either  the 
covariance  from  given  In  (13)  or  in  Information 
form 


(14) 


,-l 


filter  Implementation  may  be  combined  with  cither 
error  analysis  Implementation,  leading  to  four  . 
possibilities.  Virtually,  all  square-root  fil- 
ter/error analysis  algorithms  proposed  to  date 
can  be  viewed  ns  one  of  these  four  types.  This 
Is  summarized  In  the  following  tableau: 


\ Filter 
\ Imple- 
>^entation 

Error  'v 
Analysis^ 
Imple-  N.  . 

mentation 

Covariance  Form 

Information 

Filter  form 

Covariance 
Type  Form 

Thornton  (1976) 
(Propagates  x-x 
rather  than 
normalized  x 
and  uses  UDU*^ 
rather  than 
pl/2pT/2j^  Sec- 
tion 3 - 

Blerman  (1974 
Nlshimura  & 

Head  (1973) 
Curkendall  (1972) 

Inversion 
Duality  Morf- 
Kallath  (1975) 

Information 

Section  2 of 

Inversion 

Type  Form 

this  paper 

Duality  [6] 

The  remainder  of  the  paper  is  organized  as 
follows:  Section  II  examines  in  detail  the 
filtering  algorithm  for  the  special  case 

and  C - C®  - 0,  as  in 

the  rest  of  the  paper.  The  derivation  is  given 
in  covariance-information  form,  and  the  covari- 
ance-covariance arrays  are  quoted  (for  C and 
C®  0,  see  [6])  . 

Section  III  extends  these  ideas  to  the  general 
case  of  Incorrect  statistics,  as  well  as  model. 
Finally,  Section  IV  mentions  the  fixed-interval 
smoothing  problem. 

II.  ERROR  ANALYSIS  OF  FILTERING  WITH  INCORRECT 
STATISTICS  ONLY 


The  Pre-Array  Ci 
Defining 

^’^i"^i|[x^,uj,y[0,i-l]]'^i"’‘iltuj,y[0,l-l]]* 

"'r^ilyto.i-n’ 

then  it  is  readily  shown  that 


I 0 
0 

001 


^1 


(15) 


and 


cov  X^  ■ Block  dlag(R®,P®,Q*}  . (16) 


in  this  case  we  propagate  the 


Either 


Tljo  "filter  algorithm"  rescales  the  X^-varl- 
ables,  setting 

X^-Block  dlag{Rj'^,Py^.Qj'^)nj^- 


This  leads  to: 


i - CiUi 


(17) 


(time  Index  Is  suppressed),  however,  by  virtue 
of  (16),  we  see  that  cov  ^ I In  general.  Let 
***  * decomposition  of  cov  then 


e tf^ly  e~l  b1^7_  ^ a n 
il“*  ^ — l“^l— 1 


(18) 


Is  again  an  orthonormal  set.  Taking  the  upper 
triangular  factor  for  $ yields  finally 

fi’.iiJ (19) 

where 

Aj  - Block  diag{(R®)"\‘*,(P®)"’*P**,(Q®)'^Q**> 


Aj^  - Block  dlag{Ejj,J:p,EQ} 
Remarks 


(20) 


1.  In  case  c‘^0,  and/or  CiiO,  A^^  contains 
off-diagonal  blocks.  The  2-2  Block  entry 
remains  £p  however. 

2.  Having  obtained  (the  computed  covari- 
ance) and  , we  are  able  to  find  the 
actual  covariance  P|  . 

3.  Effect  of  the  propagation  algorithm: 

tx’.i^l  - tniTHT'C'.T’A’j] 


- IlliT]IC-,T'A'] 


(21) 


Thus,  In  the  process  of  making  lower  tri- 
angular, we  perform  the  same  operations  to  A]^. 

The  Post-Array  C? 

Similarly,  defining  ^ by: 

Ie’i,x'^lll,uJijyjo,4-i],e^,;^^^I^jl 

where  ei  are  the  innovations,  we  can  find: 

.a 


cov£" 


R*-(AK  )'-R“AK^P;JirQ 


(AKg).R* 

•Qr'P^iiAK^R* 


1+11 


A*P 


i+l|i 


"I+l|i-^’ 

Q“^"^“i+lli^’ 


(22) 


where 


^g/*l<‘'?li-l«l-Ml-l»;V‘‘e,> 


H,p 


i‘i  i-i"i 


h:  + r! 


^1  “ *^1  ■ ‘^i'’i’’i+i^i‘^i 

A»o®r'p”®  -o  r'p~^ 

^1  11+1  ^1  11+1 

The  A-terms  in  (22)  vanish  when  correct  statis- 
tics are  used.  Rescaling  according  to  the 
assumed  covariances  yields 

- Block  <24) 

and  finally 

(25) 


X - CjHj  • 


Now  again  cov  I In  general , and  reortho- 

normalizatlon  is  needed  to  yield  the  orthonormal 


set 


thus  we  have 


^2 


A2II2 


(26) 

(27) 


From  Remark  3 of  the  previous  paragraph: 

n jT  - nj 

Hi  and  TI2  span  the  same  space,  and  k-  1,2 
are  both  orthonormal  bases  for  this  space.  They 
are  therefore  related  by  an  orthogonal  trans- 
formation T.  Thus 


U,  -i. 


and 


TA^T 


Since  we  are  basically  Interested  In  £p,  we  can 
consider  factoring  (22)  In  a (permuted)  tri- 
angular form  SS*  with 


All 


X 

0 


“22 
X A 


33 


then  the  (2,2)-element  of  A2  is  exactly 
and  can  be  obtained  from  S similarly  to  (18) . 
Therefore,  we  do  not  need  to  perform  the  com- 
plete transformation  T on  the  (m  + n+p)-size 
matrix  (AjT) , but  a reduced  f*’  of  size  n suf- 
fices to  yield  (^p)^^.^* 

Remark . 


1 the  identity  Cj  cov 
n,Ci  » cov  X we  obtain  tfi 


e identities 


1.  From 
cov 

■•Itr  "1  - ",  - "g/i’  • ♦ * 


81  i 81 


(23) 


- Ue  could  have  started  from  these  equations 
to  get  the  array’s  without  going  to  the  geo- 
metrical description. 

2.  For  the  cover lance-rovar lance  form  we  simply 
invert  (18)  and  (26)  to  get: 

- ■ ^2^k*  \ -k’  ^ ^ • 

III.  GENERAL  MODELING  ERRORS 

We  now  consider  errors  ln!our  assumption  In  the 
statistics  and  the  model  parameters.  For  simplic- 
ity however,  we  assume  here  that  C ° 0;  non- 

sero  case,  see  [6].  In  order  to  reduce  the 
notational  burden  we  omit  the  explicit  time  depen- 
dence of  the  model  parameters.  As  a first  step  in 
obtaining  a representation  of  In  terms  of  an 
orthonormal  set,  we  Invert  the  equation  x *■  ^iHi 
to  obtain 

- r”**!  (AH  - H4'"^A*)Xj^  - H*~^Aruj^  + v^) 

^-p2^[(Xj-x^|j_j)+0  ^A4'Xj^+*  ^AFu^] 

**i|  i-i“  \ ^~***~^^**i + P2**«~^Aru^ 


A*  _ *;  AH-H* 


H;  AF  - F*  -F  . 


A new  subtle  point  arises,  when  the  system  matrices 
are  nlsmodeled,  the  pre-array  variable  above, 
Is  no  longer  equal  to  X^,  the  post-array  variable 
of  the  previous  time  step. 

Furthermore,  we  see  that  to  obtain  a self-con- 
tained recursion,  we  must  augment  the  ^ variables 
with  the  actual  state  Xj^. 

Suppose  we  have  available  a representation  for 
the  augmented  state  In  terms  of  orthonormal  vari- 
ables' 


<i].K  °]^i 

*lj  [^xA  \\h 


v^  - W\ 


are  certainly  orthogonal  to  the  augmented  state. 
Therefore  using  (28)  and  the  equation 


X “ ^^x  F^u 
*1+1 


We  can  set  up  the  following  representation 
y,  ■)  rR"’*(AH-H}~^A5)L  ' R"’*(aH-H«"^A5)L  ' 


A 1 xA 


pT’’«"^a*l 

1 X 


-R“‘*H*“’’dr(Q")**  ' R"’*(R*)**1 


p"'**“^af(q“)‘‘ 

Q-‘*(Q“)‘^  ' 

F^(Q*)’* 


This  corresponds  (In  augmented  form)  to  Eq.  (18) 
of  Section  II.-  The  above  array  corresponds  to 

(a;)-^ 

We  apply  on  the  left  of  the  above  array  the 
orthogonal  transformation  which  updates  r)]^  to  n?; 
that  Is,  we  apply  the  transpose  of  the  transforma- 
tion which  updates  the  filter  array  to  C2,  thus 


*i+lj  L*“^xA  . ° J 

(The  X's  denote  entries  of  no  particular  Interest J 
We  now  apply  orthogonal  transformation  on  the 
right  of  the  above  array  to  bring  the  second  and 
fourth  block  rows  to  the  form 


i1  Tla  0 6 0- 

ij  L'-xA  ° 0. 


This  yields  La,  the  square-root  covariance  of 
^1+1  updates  (28)  to  time  1+1.  We  can 
egslly  Initialize  (28)  at  time  0,  when 

^0  “ *0  “ ^0^' 

Remark . 

1.  There  Is  some  redundancy  in  considering 
AF  0 and  Q together,  because  F and 
Q only  arrive  In  the  combination  FQ^.  So, 
we  can  always  define  a Qequlv  “ I.  I'equlv  " 
rq*.  In  this  case  AT  jt  0,  but  Qequlv  " QSquiV 
Alternatively,  if  (il,  rQs)  forms  a controllable 
pair,  then  we  can  set  Qequlv  ^QF'  and  . = 1 

thus  AT  ■ 0 If  both  (0®,  r*Q®«)  are  controllable. 


Choosing  OjXi  as  the  "augmenting"  state  to 
X,  and  expressing  x*  ■ [(♦jXj^) ' ,x')  In  terms 
of  Tl*'  “ ^*l|l-l’— 1 ^ glves*an  augmented  pre- 
array C][  vhicn  contains  Cj , and  Is  Itself 
In  upper  triangular  form  (note  that 
Xji,  ,X  X,,,  , with  correct  model  and  statls- 


we  express 
» _ 


(x',(C>jXj) ')  In  terms  of  nj  » ll!i»Xn.j|lJ 
which  yields  a lower  triangular 
Cj  with  C,  contained  in  It 


1 

_0_ 

0 _■ 

Ht 

It 

0 

' ^ 

HP** 

0 

0 

1 

0 

♦P** 

rq’’ 

ill 

0 

1 

0 

0 

0 

0 

' o' 

X • 

ic 

p** 

1+1 

0 

’ 0 

D _ 

E _ 

t 

-FD 

i+1 

-PE 

-rq"** 

'•’l. 

The  augmented  A- arrays  are  quite  involved  however, 
see  [6]. 


IV.  SMOOTHING 


We  now  briefly  describe  how  to  extend  the  algo- 
rithm of  Section  III  to  the  square-root  form  of 
the  two-filter  fixed-interval  smoother.  Each 
filter  will  have  an  error  analysis  addendum  propa- 
gated according  to  the  idea  of  Section  III.  Here 
we  will  Just  point  out  the  modifications  needed  in 
the  separate  filters  to  facilitate  a smoothing 
solution  and  demonstrate  how  to  combine  informa- 
tion from  the  two  filters  to  obtain  an  for  the 
smoothed  estimate. 

The  backward  filter  is  implemented  in  informa- 
tion form  since  it  is  initialized  with  infinite  a 
priori  covariance.  However,  the  i]jc  “ 1»2  vari- 
ables are  the  same  for  both  information  and  co- 
variance  filters.  Therefore,  when  the  only  model- 
ing error  is  in  the  statistics,  the  error  analysis 
algorithm  is  unchanged  from  Section  II  . When 
there  are  mismodeled  system  matrices  and  the 
are  augmented  by  Xi,  it  must  be  remembered  that  u^ 
is  not  orthogonal  to  x^+x.  Probably  the  most 
straightforward  way  to  obtain  a representation  for 
(^,x')'  in  terms  of  an  orthonormal  set  (that  is 
to  obtain  the  array  analogous  to  the  inverse  of 
(18) , (26)  is  to  decompose  ux  as 


‘^i^l  ”i+l’'i+l'‘‘“i|x 


1+1 


1+1 


cov(x^^j^) 


(31) 


where  ti . . is  orthogonal  to  u,  , , and  has 
* 1+1 

covariance 


When  there  are  mismodeled  system  matrices,  the 
augmented  state  in  both  forward  and  backward  error 
analysis  arrays  should  be  represented  in  the  form 


•n’* 

0 1 Cx]  X' 

^A 

0 ■ 

^ll 

• 

rather  than 

■ 

> 

Cj  * 

_^xA 

L 

x_ 

^2. 

(32) 


Decomposing  each  Xx  into  a component  correlated 
with  and  a component  orthogonal  to  the  actual 
(tate  enables  us  to  get  a Joint  representation  for 
(from  forward  filter)  and  (from  backward 


filter).  We  have  the  separate  representations 


M 


Ax 


M 


.f 


and 


X*’ 

^1 


'-n’* 


"L  "4 


(33) 


C.  must  be  related  to  C,  sn  orthogonal  trans- 
formaiclon.  Cx  “ ^x  Insist  on  a unique  form 

for  n^,  say  lower  '‘'triangular  with  positive  di- 
agonal elements.  Some  study  reveals  [6]  that 
is  a function  of  (uq, . . . ,Ux_x)  and  (vg,... 
while  is  a function  of  tux,...,ui]}  and 
{vx,...,vjj}  where  the  smoothing  Interval  is 
1 ••  1,...,N.  Thus  and  are  orthogonal  and 
we  may  write 


,vx. 


■l). 


x** 

x^ 

''i 


"L  0 


(3A) 


When  we  have  only  Incorrect  modeling  of  statistics 
this  simplifies  to 


The  forward  filter  may  be  Implemented  in  either 
covariance  or  Information  form.  For  purposes  of 
Illustration,  let  us  assume  a covariance  forward 
filter  and  an  information  backward  filter.  To 
confine  the  estimates  of  the  two  filters  to  obtain 
a smoothed  estimate  we  may  interpret 

S d** 

"•ill  “i 

output  matrix  (Pp  which  is  to  be  used  to  update 

s i 


d"  as  an  additional  measurement  with 


■^ili-l  interpretation  is  Illustrated 

beiw‘wlth  corresponding  quantities  one  under  the 
other 


H 


x^  + Vi 

X,  + 5^ 


(35) 


Zb 


The  "measurement  noise"  Xx  is  assumed  by  the 
filter  to  have  unit  covariance;  so,  the  appropri- 
ate measurement  update  is  given  by  the  following 
arrays: 

®1  111-1 
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x^ 
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(36) 


Lower  trlangularlzing  (36)  with  orthogonal 
transformations  on  the  right  gives  the  post-array 


di  (Pp  Xx|l-1 


*1  "*11 1-1 
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I 


The  smooched  estimate  of  Is 


’‘i  ” * Vi  ^‘*1 


^*^1^  ’‘i|l-l 


(37) 


and 


The  set  {Xj,Vj}  Is  obtained  from  the  set  {X^.X^} 
through  the  array  update  transformation.  Applying 
the  same  transformation  to  the  representation  (34) 
for  {X^.jJp  yields 


An  additional  orthogonal  transformation  applied  on 
the  right  will  give 


K-K  0 ^1 

^2 
^3 

J 


(3») 


V.  CONCLUSION 

By  viewing  the  square-root  arrays  as  represen- 
tations of  the  estimate  residuals  In  terms  of 
orthonormal  sets  of  random  variables  we  have 
expressed  a framework  for  the  known  square-root 
error  analysis  algorithm.  This  framework  led  us  to 
a new  algorithm  presented  herein  which  Is  compat- 
ible with  either  the  covariance  or  Information 
Implementations  of  the  filter. 
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